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(54) Multimedia information service access 

(57) Real time delivery of multimedia information 
accessed either through the Internet, or otherwise, 
simultaneously, or sequentially time delayed to one 
more users, is enabled by delivering the multimedia 
information over a switched network via a multipoint 
control unit. A client establishes a connection with a 
server, or other remote location where desired multime- 
dia information is resident, identifies the desired multi- 
media information and provides client information 
identifying the locations of the users. The client informa- 
tion may include the telephone numbers or other access 
numbers of each of the multiple users. The multimedia 
information is then delivered by a multimedia server to a 
bridging apparatus through a switched network guaran- 
teeing high quality of service, secure connection and 
billing control. Connecting one or more users to a live 
agent is also made possible by providing the telephone 
numbers of the users and the live agent directly to the 
multipoint control unit. The delivery of the multimedia 
information can be secured by comparing the client 
Information to a segmented "to call" list to determine 
whether the client is authorized to receive the requested 
multimedia information. Alternatively or in addition, 
security can be implemented by mounting a video cam- 
era at the client's endpoint and connecting a database 
running face recognition software to the multimedia 
server. The multimedia server's call to the user triggers 



the camera to take a picture of the user. The selected 
content is restricted to authorized users by comparing 
the picture to pictures of authorized faces stored in the 
database. 

FIG. 2 
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Description 



The present application is related to U.S. Patent 
Application Serial No. 08/402.664 filed on Martch 13, 
1995, and is entitled "Client-Server Architecture Using 
Internet and Public Switched Networks." These two 
applications are co-pending and commonly assigned. 

Technicai Reid 

This invention relates to real time multimedia infor- 
mation broadcast over circuit switched networks and, 
more particularly, provides a client-server architecture 
utilizing the Internet and public switched networks and a 
method for using the same for the delivery of real time 
multimedia information to one or simultaneously to 
more than one end user. 

Backgro und of the invention 

The Internet's global and exponential growth for 
searching for information sources is common knowl- 
edge today. TTie Internet is implemented using a large 
variety of connections between millions of computers. 
The recent developments on information navigation 
software and user interfaces, such as Netscape Naviga- 
tor, coupled with a continuously growing number of pub- 
lic access providers are making the Internet a 
fundamental component of the information age, if not 
the information super highway itself 

The usage and demands on the network capabili- 
ties, however have frustrated many users in attempting 
to view large bodies of information. Video and high fidel- 
ity audio are particularly prone to service degradation. 
Contention for t)andwidth to transport information can 
delay or fragment the delivery of blocks of information. 
Large image files can suffer from annoying delay in their 
delivery and storage and memory capacity of desktop 
computers and workstations pose limitations to the 
amount of information that can be downloaded. For 
example, downloading a five minute video file can take 
more than sixty minutes, especially when the sen/er 
from which the video Is obtained is located in a distant 
geographic location, and the user would need very large 
storage capacity. 

In addition to the quality of the received information 
and storage constraints, tiie Internet raises other con- 
cerns, including a guaranteed or consistent quality of 
service, security, and an easy and flexible mechanism 
to charge for transactions. 

What is desired is a practical way to provide real 
time multimedia information, accessed through the 
Internet or otherwise, to one or more users with a guar- 
anteed quality of sen/ice. security, and a charge mech- 
anism for handling service requests made over the 
Internet. Where multiple users are to receive the infor- 
mation, one client shoukl be able to control the temporal 
ntanner according to which the information is to be 
delivered to the multiple users, whether simultaneously 



or according to a time delay sequence. 

Summary of the Invention 

5 Accordingly, it is an objective of the present inven- 

tion to provide real time delivery of multimedia informa- 
tion either simultaneously, or according to a time delay 
sequence, to multiple users. In accordance with the 
present invention, either through the Internet, or other- 
10 wise, a client, the principal user, establishes a connec- 
tion witii a server, or other remote location where 
desired multimedia information is resident. The client 
identifies the desired multimedia information, provides 
client information identifying tine location of the multiple 

15 users and indicates the desired tenporal scheme for 
delivering tfie multimedia information to the multiple 
users. The client information may include the telephone 
numbers or other access information of each of the mul- 
tiple users. The multimedia information is then delivered 

20 by a multimedia server to a bridging apparatus tiirough 
a switched network on a circuit connection guarantee- 
ing high quality of service, secure connection and billing 
control. The bridging apparatus delivers the multimedia 
information to the multiple users using the telephone 

25 numbers provided by the client to the multimedia infor- 
mation server and according to the requested temporal 
scheme. The multimedia server can also terminate the 
call after the multimedia information is delivered, or initi- 
ate additional transactions. 

30 The client-server architecture of the present inven- 
tion can be also used to connect one or more users to a 
live agent- When a user requests a connection to a live 
agent, the server provides the telephone numbers of tiie 
users and the live agent to the bridging apparatus which 

35 tiien controls the multiparty connection. 

It is another objective of the present invention to 
provide means for securing the delivery of multimedia 
Information and the live agent transfer of data in accord- 
ance with the present invention. In furtherance of this 

40 objective, a first security step includes comparing the 
client information to a segmented "to call" list to deter- 
mine whether the client is authorized to receive the 
requested multimedia information. 

A second security step can also be implemented 

45 where a client's endpoint is enabled for video telephony 
A video camera is mounted at the client's endpoint arKi 
a database running face recognition software Is con- 
nected to the multimedia information server. When the 
multimedia server calls the client to deliver the 

50 requested data, the camera is activated, taking a picture 
of the client. The picture is compared to a datat>ase of 
authorized faces, thereby enabling the restriction of 
selected content to authorized viewers only. 

55 Brief Description Of The Drawings 

FIG. 1 shows an illustrative client-server architec- 
ture for multiparty delivery of multimedia information 
using the Internet and a public switching network. 



2 



BNSDOCID: <EP 0808048A2J_> 



3 



EP0808 048 A2 



4 



FIG. 2 depicts the architecture used for real time 
multimedia information delivery according to the 
present invention by accessing the multimedia informa- 
tion without the Internet 

FIG. 3 shows an illustrative client-server architec- 5 
ture for multiparty delivery of multimedia information 
using the Internet and a public switching network with 
enhanced security. 

Detailed Description Of The Invention 

The present invention enables the simultaneous, or 
sequential time delay transmission of multimedia infor- 
mation, to one or more users in real time. Multimedia 
information as used herein includes, although not lim- 
ited to, recorded and live video and audio clips, image 
files and text files. By using an ISDN enabled endpoint 
for video telephony, the multimedia information can be 
delivered with a guaranteed quality of service, security, 
and an easy and flexible mechanism to charge for the 
information and transmission services, even if these 
features are not available via the means by which the 
multimedia information was accessed by the client, as 
for example the Internet. 

Referring to FIG. 1, a client-server architecture is 
shown where client apparatus 100, may be a personal 
computer, a workstation, or other similar interface. At 
the client end two logical network connections or inter- 
faces, 102 and 103 are required. Interface 102 provides 
a connection to an Internet server to which the user can 
connect using an appropriate transfer protocol, such as 
the hyper text transfer protocol ("http") through Internet 
150. This connection can be made through a local area 
network (LAN), through a Serial Line Internet Protocol 
(SLIP) connection over a modem, or through a Point to 
Point Protocol (PPP) over an ISDN port. The Internet 
server will access the multimedia information source 
based on its address. Alternatively, multimedia informa- 
tion source 120 can be accessed directly via a conven- 
tional telephone line, as described below in connection 
with FIG. 2. The telephone connections can be made 
either through a private connection or through a pufcdic 
switched telephone network (PSTN). 

Interface 103 provides a connection to a public or 
private switched telephone network through an ISDN 
port enabled for video telephony. As shown in FIG. 1, 
the connection to switched network 160 can be made 
through bridging apparatus 170. A bridging apparatus 
allows for various temporal schemes for the delivery of 
information to multiple users, such as simultaneous 
delivery, or sequentially delivering the information to 
each user with an arbitrary time delay, by acting as a 
single node for receiving the requested information and 
then fonfvarding the received information to each of the 
connected end users. One bridging apparatus known to 
those skilled in the art is the multipoint control unit, more 
fully described in William J. Clark, "Multipoint Multime- 
dia Conferencing" IEEE Communications Magazine 
pp.44-50 (May 1992). and Mark J. Koenig and Martin J. 



Welt, "MCUs Help Take the Worry Out of Being There" 
AT&T Technology-Products, Systems and Services. 
Vol. 9 No. 4 pp 12-15 (Winter 1994). both of which are 
hereby incorporated by reference as if fully set forth 
herein. 

As stated above, the connection between the client 
and the switched network is made through an ISDN port 
enabled for video telephony. One preferred standard for 
video telephony is H.320. a telecommunications stand- 
ard for voice, data, video communications used for 
desktop video services, described in more detail in, 
Robert M. Howe III. "Vistium Products Give Another 
Point of View" AT&T Technology-Products. Systems 
and Services. Vol. 9, No. 4 pp 18-21 (Winter 1994). 
hereby incorporated by reference as if fully set forth 
herein. 

It should be noted that the two interface connec- 
tions 102 and 103 are defined at the logical level, that is, 
client apparatus 100 may have a single physical con- 
nection that can connect it to both the Internet 150 and 
public switched network 160. Generally, the system of 
FIG. 1 enables a plurality of client computer-based 
apparatuses to access a plurality of servers 130 which 
in turn locate and receive the multimedia information 
through public switched network 160. 

The present invention can be used for the real-time 
delivery of recorded as well as live video and audio. An 
example of delivering live video and audio to a client 
includes connecting the client to a live sales agent to 
respond to the client's questions and to receive product 
orders. 

To enable live service requests, one of the multime- 
dia servers 140 may initiate a call connection over the 
public switched network 160. using a telephone number 
provided by the client apparatus 100 as part of the serv- 
ice request, and deliver information for the requested 
service. This call may be billed by any of the standard 
call billing methods, e.g., collect or third part billing, etc. 
For such an application or service, the public switched 
network 160 provides the billing for the service and 
transmission as provided in a normal call made over the 
public switched network 160. Since the connection over 
the public switched network provides enhanced secu- 
rity, complicated identification mechanisms are not 
needed. 

In one example of using the client-server architec- 
ture of FIG. 1 the client, the principal user, will typically 
use an application such as Netscape Navigator to 
access http server 130 from his client apparatus 100, 
via the Internet 150. When the client requests the deliv- 
ery of information that is preferably not to be delivered 
over the Internet, or otherwise requires a phone con- 
nection, the client will be prompted to provide identifica- 
tion information, if not already provided, and optionally 
to select a temporal scheme for delivering the informa- 
tion. The identification information may include the cli- 
ent's telephone number. The http server 130 will pass 
this identification information to multimedia server 140 
to place a circuit switched call to the client. The multime- 
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dia server includes a video telephony enabled port, 
such as an H.320 enabled ISDN port. When a server 
receives a request for an application or service which 
requires a phone connection, it activates a new process 
which handles calling the phone number associated 
with this request. This multimedia server process can 
run on the same controller operating the http server 
130. or It can be run on another machine connected to 
the first controller, as for example by means of a LAN. 
This process can be implemented with the Common 
Gateway Interface (CGI) for which public software 
implementations are available for http servers. The CGI 
is an open interface specification that can be obtained 
from the internet and is more fully described in Eric Her- 
mann. "Teach Yourself CGI Programming with PERL In 
A Week" (Sam Publishing January 1996). hereby incor- 
porated by reference herein as if fully set forth herein. 
Several programs for automatic dialing of PSTN or 
ISDN numbers are available for various computers, e.g.. 
Intel ProShare and can be used for this purpose. Client 
apparatus 100 includes a program that accepts incom- 
ing phone calls. Such software is also available from 
many vendors, e.g., Intel ProShare. 

The multimedia server 140 retrieves the multimedia 
information from the multimedia information source 120 
and dials the client, or the bridging apparatus as the 
case may be. and forwards the content accordingly. If 
bridging apparatus 170 is used, the telephone numbers 
of the users waiting to receive the requested multimedia 
information is first forwarded to the bridge 170. The 
bridging apparatus 170 and multimedia server 140 can 
be connected over a LAN, a switched network, or other 
suitable means. The bridging apparatus 170 then dials 
the users' telephone numbers and delivers the multime- 
dia information to each of the identified users according 
to the selected temporal scheme. After delivery is com- 
plete, either the client apparatus 100 or the multimedia 
server 140 may terminate the switched network connec- 
tion. If the client chooses to have the requested informa- 
tion delivered to more than one user simultaneously the 
multimedia server 140 will wait for the bridging appara- 
tus 1 70 to establish a connection with each of the users 
and then transmit the requested information to the 
bridging apparatus 170. Bridging apparatus 170 then 
channels the requested information to each of the 
users. 

The client can also choose to have different users 
receive the content at different times. For example, one 
user or a group of users may be selected to receive the 
information at 9:00 AM, with another user or group of 
users to receive the same information at 9:30 AM. In 
this embodiment of the present invention, it is preferable 
for the multimedia server 1 40 to transmit the information 
to the bridging apparatus 170 at each of the selected 
times. Alternatively, the multimedia server 140 could ss 
transmit the information to the bridging apparatus 170 
once and another server connected to the bridging 
apparatus 170 could store the information and control 
the time delayed delivery to the selected users. 



The client-server architecture of the present Inven- 
tion allows for multiple http servers to share a single 
multimedia information server, and for a single http 
server to be able to access multiple multimedia servers. 
5 In addition to enabling simultaneous real time deliv- 

ery of multimedia information to multiple users, the cli- 
ent-server architecture of the present invention can also 
be used to provide a live video and/or audio connection 
to another party such as a vendor's customer service 
10 agent For example, a client visiting a vendor's web site 
may place a request to speak with a live agent. The http 
server will transfer the client's telephone number and 
the number for the live agent directly to a bridging appa- 
ratus which will set up the multipoint multimedia con- 
15 nection between agent and client. 

Simultaneous or subsequential time delayed deliv- 
ery of multimedia information to one or more users 
according to the present invention is also possible with- 
out accessing the multimedia information through the 
20 Internet. Instead, a client can place a request for multi- 
media information over a conventional telephone line, or 
other non- Internet means, such as placing an order by 
facsimile. By providing the user's telephone number to a 
multimedia server, real time multimedia information can 
25 be delivered to the user over an ISDN line using H.320. 
Referring to FIG. 2, an implementation of the 
present invention is shown where client 210 places a 
telephone call to multimedia server 250 and is con- 
nected to a Voice Response Unit (VRU) 220. This user 
30 is prompted via a menu selection to input a security 
code, which is compared to a list of authorized codes 
maintained in database 230. After establishing the 
user's identity, the user could be guided through a menu 
selection of available multimedia information content. 
35 Alternatively, or in addition, the person could be 
prompted to input his/her fax number, so that fax server 
240 can immediately send a similar or more detailed 
menu. The user would then transmit his or her selection 
and the telephone number of Group Video Room 280 or 
40 other video receiving apparatus having an ISDN port 
enabled for video telephony. This In turn would trigger 
the real-time delivery of the selected multimedia infor- 
mation content. In the same way. as described above 
simultaneous or sequential time delayed delivery to 
46 multiple users through a bridging apparatus, such as 
bridging apparatus 260. is possible as well. 

Referring to FIG. 3, it is possible to enhance the 
security of the multimedia information delivery transac- 
tion according to the present invention provided by the 
switched network, by Including a database function con- 
nected to the multimedia server through security server 
complex 302. which would have a segmented "to call" 
list 304. When a client inputs a specific telephone 
number to receive the multimedia information server 
302 queries the "to call" database 304 to verify whether 
the particular endpoint is authorized to receive that spe- 
cific information. If the endpoint is not allowed to receive 
that information, the video call Is not connected. A mes- 
sage conveying the lack of authorization and/or the 
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failed connection can be displayed to the cfient over the 
Internet connection 150. 

It is also possible to enhance the security of the 
transmission of multimedia information according to the 
present invention by including a video camera 301 at 5 
the client's end. When the multimedia server 140 dials 
the client's video telephony enabled port, camera 301 is 
activated which in turn triggers a video capture algo- 
rithm on the multimedia server side. In essence a snap- 
shot is taken of the person about to receive the io 
multimedia information. The snapshot can be run 
through a separate database 303 and security server 
complex 302 (or 290 as shown in FIG. 2) connected to 
the multimedia server 1 40 and run face recognition soft- 
ware. In highly secure applications where specific video 75 
content should be viewed by only a select number of 
people (e.g. future advertising can be viewed, daily 
rushes from movies in the making can be reviewed, 
future press announcements can be reviewed, etc.) the 
system would have the ability to restrict viewing to 2o 
select users. 

The snapshot may also be used to maintain usage 
statistics, including who viewed what content, when. 

The foregoing merely illustrates the principles of the 
present invention. Those skilled in the art wilt be able to 25 
devise various modifications, which although not explic- 
itly described or shown herein, embody the principles of 
the invention and are thus within its spirit and scope. 

Claims 30 

1 . A method for real-time delivery of multimedia infor- 
mation from a remote location to one or more users 
including a principal user, comprising the steps of: 

35 

establishing a first line of communication 
between said principal user and said remote 
location; 

requesting a temporal scheme for the delivery 40 
of multimedia Information from said remote 
location to each of said users; 

establishing a second line of communication 
over a switched network between a multimedia 45 
server, and a bridging apparatus, said bridging 
apparatus being connected to each of said 
users; and 

delivering in real-time said requested multime- so 
dia information to each of said users through 
said bridging apparatus, according to said tem- 
poral scheme. 

2. A method according to Claim 1 wherein said tempo- ss 
ral scheme includes the simultaneous delivery of 
said requested multimedia information to each of 
said one or more users. 



8 

3. A method according to Claim 1 wherein said tempo- 
ral scheme includes delivering said requested mul- 
timedia information to said one or more users In a 
time delayed sequence. 

4. A method according to Claim 1 wherein said first 
line of communication includes establishing an 
Internet connection. 

5. A method according to Claim 1 further comprising 
the step of providing identification information of 
each of said plurality of users to said multimedia 
information server by said principal user 

6. A method according to Claim 5 wherein said identi- 
f k:ation information Includes one or more telephone 
nurrbers for said plurality of users. 

7. A method according to Claim 1 wherein said 
switched network is an Integrated Services Digital 
Network (''ISDN") enabled for multimedia Informa- 
tion telecommunications. 

8. A method according to Claim 7 wherein said ISDN 
is enabled for H.320. 

9. A method according to Claim 1 wherein said multi- 
media information includes live video. 

10. A method according to Claim 1 wherein said multi- 
media information includes live audio. 

11. A method according to Claim 1 wherein said bridg- 
ing apparatus is a multipoint control unit. 

12. A method for connecting a user on the Internet to a 
live agent, comprising the steps of: 

establishing a first line of communication 
between said user and an Internet server; 

receiving a request from said user to be con- 
nected to said live agent; 

requesting said user to provide identification 
information to said Internet server, said identifi- 
cation information including a telephone 
number at which a switched network call can 
be placed to said user; 

receiving said identification information; 

providing said user identification information to 
a bridging apparatus: 

connecting said live agent to said bridging 
apparatus; and 

placing a switched network call to said user 
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from said bridging apparatus thereby connect- 
ing said user to said live agent. 

13. A method for securing the delivery of multimedia 
information by a multimedia server to a user 5 
requesting said multimedia information over a 
switched network, comprising the steps of: 

maintaining a database of user identification 
and corresponding authorization for receiving io 
said multimedia information; 

receiving identification information from said 
user at said multimedia server; 



comparing at said multimedia server said 
received identification information with said 
user identification and corresponding authori- 
zation maintained on said database; and 

delivering said multimedia by said multimedia 
server information to said user only if said com- 
parison indicates said user is authorized to 
receive said multimedia Information. 

14. A method for securing the delivery of multimedia 
information from a multimedia server to a user end 
point over an ISDN switched network enabled for 
video telephony, comprising the steps of: 

maintaining a database of pictures of users 
authorized to receive said multimedia informa- 
tion; 

activating a video camera located at said user 
endpoint to take a picture of said user prior to 
delivering said multimedia information; 

triggering a video capture algorithm at said 
multimedia server to capture a picture of said 
user; 
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comparing said captured picture of said user to 
said database of pictures of users authorized to 
receive said multimedia information; and 45 

delivering said multimedia information to said 
user only if said comparison indicates said user 
is authorized to receive said multimedia infor- 
mation, so 

15. A client-server architecture for real-time delivery of 
multimedia information from a remote location to 
one or more users including a principal user, com- 
prising: 55 

a first line of communication between said prin- 
cipal user and said remote location; 



a multimedia information server for accessing 
said multimedia information from said remote 
location; 

a bridging apparatus for delivering said multi- 
media information to each of said plurality of 
users according to a selected temporal 
scheme; and 

a second line of communication over a 
switched network between said multimedia 
server and said bridging apparatus for real- 
time delivery of said requested multimedia 
information to said bridging apparatus, 
whereby said bridging apparatus delivers said 
requested multimedia information to said one 
or more users. 

16. A client-server architecture according to Claim 15 
wherein said temporal scheme includes means for 
the simultaneous delivery of said requested multi- 
media information to each of said one or more 
users. 

17. A client -server architecture according to Claim 15 
wherein said temporal scheme includes means for 
delivering said requested multimedia information to 
said one or more users in a time delayed sequence. 

18. A client-server architecture for connecting a user on 
the Internet to a live agent, comprising: 

a first line of communication between said user 
and an Internet server; 

means for requesting a connection to a live 
agent; 

means for providing identification infornriation of 
said user to said i Internet server, said identifi- 
cation information Including a telephone 
number at which a circuit switched call can be 
placed to said user; 

means for providing said user identification to a 
bridging apparatus; 

means for connecting said live agent to said 
bridging apparatus; and 

a switched network for placing a switched net- 
work call to said user from said bridging appa- 
ratus thereby connecting said user to said live 
agent. 

19. A system for securing the delivery of multimedia 
information to a user requesting said multimedia 
information over a switched network, comprising: 
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a database of user identification and corre- 
sponding authorization for receiving said multi- 
media Information; 

means for receiving identification information of 
said user; 5 
means for comparing said received identifica- 
tion information with said user identification 
and corresponding authorization maintained 
on said database; and 

means for restricting the delivery of said w 
requested multimedia information to said user 
if said comparison indicates that said user is 
not authorized to receive said multimedia infor- 
mation. 

75 

20. A system for securing the delivery of multimedia 
information from a multimedia server to a user end- 
point over an ISDN switch network enabled for 
video telephony, comprising; 

a database of pictures of users authorized to 
receive said multimedia information; 

a video camera located at said user endpoint; 

means for activating said video camera prior to 
delivering said multimedia information; 

means for triggering a video capture algorithm 
at said multimedia sen/er to capture a picture of 30 
said user; 

means for comparing said captured picture of 
said user and said database of pictures author- 
ized to receive said multimedia information; 35 
and 

means for restricting the delivery of said multi- 
media information to said user if said compari- 
son indicates that user Is not authorized to 40 
receive said multimedia information. 
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